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A set of Markov processes corresponding to systems of liard-core particles interacting along the 
line are shown to be solvable via a dynamic matrix product ansatz (DMPA). We show that quantum 
spin Hamiltonians can be treated by the DMPA as well, and demonstrate how the DMPA, originally 
formulated for systems with open ends, works for periodic systems. 
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. Recent advances in nonequilibrium statistics have allowed for the clarification of many important issues such as 
' exact description of nonequilibrium phase transitions, microscopic structure of shocks, dynamical scaling etc. [1]. 
, Dynamical systems of stochastically hopping hard core particles (the so-called exclusion processes) have been at the 
CO ' heart of this development, in particular due to remarkable observation that one can find exactly the probabilities of 
all system configurations in a stationary state. It was subsequently noticed that for the totally symmetric exclusion 
process one can as well solve the evolution dynamics, namely to find conditional probabilities P(i^, tji^", of the 
system being at state ly at time t provided that it was in state at time t° via coordinate Bethe Ansatz [2]. The 
. dynamical matrix product ansatz (DMPA) proposed in [3] has recovered the results of [2] in a more straighforward 
manner. But for technical reasons to be explained later, application of the DMPA was incomplete in periodic systems. 
, In this communication, we show how the DMPA is applied for periodic systems. Alongside, we demonstrate that 
' the DMPA can be used for testing the stochastic processes and/or one-dimensional spin chains for integrability. The 
, integrability restrictions come from the consistency conditions on the algebra generated by the DMPA, which has to 
satisfy the Yang-Baxter equation. The important difference from the conventional approach is that we start directly 
, from the Hamiltonian and do not need a parameter-dependent transfer matrix, commuting with it. 
. The continuous time dynamics of Markov process is defined via the master equation for the probability P{i',t) of 
I ■ the system being at state v at time t, 
Oh! 

^ ; dP{u, t)/dt = Pi"'^ t)wu'^. - P(j^, t) J2 w-^^-^' (1) 

>. 

' where Wj^^^i is the rate with which the system can change its configuration from v to v' . 
rS \ For definiteness we consider a system of identical particles on a lattice of L sites. Each site fc can be either occupied 

■ by a particle (local occupation number = 1) or be empty ( — 1). The set of occupation numbers for all sites 
constitutes the configuration of the system. The system can change its configuration via hopping of any particle 
to an empty nearest neighbour site. At any infinitesimally small moment of time dt at most one such process can 
happen, namely the particle can hop to the empty site to the right /to the left with the rates Dji and £>l respectively. 
Now, consider a vector space W = n (^C^ Notice that one can establish one-to-one correspondence between 
configurational space of our particle system and canonical basis of W; \r]) C W, with the scalar product ^.v|\r]) = Sr^n'- 
The local particle number operators have form Uk = / (8) . . . / (E) 622 • . . / , and en respectively for holes. Cy denotes 
a matrix with {eij)ki = SikSji, and it stays in the A:-th place in the tensor product expression above. / is the unit 2x2 
matrix. 

With the help of above notations the set of equations (1) can be rewritten as single vector equation ( we ask the 
reader to refer e.g. to [1] for the details of the scheme). 

d\P(t)) , , 

= -H\P{t)) (2) 

where \P{t)) = E,,CW ^vi*) Hr,r,' = -W^'^r,, H^r^ = Y.ri' Wri^n'- 

Due to the fact that the hopping is restricted to the nearest-neighbouring sites, the Hamiltonian above is the sum 
of local two-site Hamiltonians, H — ^n,n+i given by 
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4/i„,„+i = Dn ((1 - + - + Dl ((1 + <)(1 - - ^-^++0 (3) 

where cr^, cr^ = cr^ ± icr^ are Pauli matrices. 

Note that (2) has a form of a Schrodinger equation in imaginary time, and the Hamiltonian (3) the form of a 
nonhermitian spin Hamiltonian with nearest neighbour exchange interaction. 

The global Hamiltonian H possesses an U(l) symmetry, [H, J2n ^n] — 0- The general hermitian spin Hamiltonian 
satisfying the latter relation is XX Z Hamiltonian, 

H = jY^ a^a:^, + alal^, + A - /) . (4) 

n 

Thus Schrodinger quantum problem and Markov process for interacting particles are closely connected. In the 
following we show how to find the spectrum of H and how to single out integrable models. 
To demonstrate how the DMPA works, we start from the Hamiltonian of the form 

L /O 0\ 

H=f2hn,n+i; h=\llll\ (5) 
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with arbitrary entries /. u, v, which contains both the stochastic (3) and quantum spin system (4). We shall consider 
a system on a ring with L sites. One proposes to search for time-dependent probability distribution vector \P{t)) in 
the following form: 



\m) ^ Tr 



E\'''-^ [ EQ\ 



(6) 



where E, D, Q are some time-dependent matrices. The probability of a given configuration v is given by the scalar 
product of the above vector with the basis vector of the configuration, P(i/, t) = {v\P{t)). For example, probability 
Prjit) of a state 77 = {0 A A} for a system of 5 sites is sought in the form P^(i) ^ Tr (E E D E D Q), up to 
normalization. 

One requires matrices E,D,Q such that (6) satisfies the master equation (2). To simplify matters, first take Q in 
(6) to be a unit matrix Q = I (this would allow to retrieve the translationally invariant part of the H spectrum as we 
shall see below). Given that, and that the Hamiltonian in (2) splits into local ones, H = /ii,2 + /i2,3 + - • • hL-i,L + hL,i, 
it is sufficient for the purpose that the matrices E, D satisfy quadratic relation 



2dt J \DJ \DJ \XJ \DJ \DJ \X 
conveniently written in short form 



/i |A)(^|A) = |X)®|A)-|A)(^|X). (8) 



1 d 
2di 

where (A| = {E £»), (X| = {X° X). 

For Q ^ I which is generic case one gets two additional relations in addition to (8), connected with the action of 
the terms /li-i,!,, of the Hamiltonian: 

~ + |A)(g)|AQ) = |X)0|AQ)-|A)®|XQ) (9) 

+ |Ag)®|A) = |XQ)^|A)-|AO)®|X) (10) 

Equation (8) gives the relations for the matrices E,D while Eqs. (9,10) impose restrictions on Q. 
Equation (7) has four components: 



^(^EE + EE^ =X°E-EX° (11) 

ED + ED^ + fED + uDE = X°D - EX (12) 

i (dE + DE^ + gDE + vED = XE - DX° (13) 

^ (j)D + DDj =XD-DX (14) 
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Using the reduction 

E = 0; X° = 0, (15) 
Eq. (11) is satisfied trivially. Supposing additionally that exists, we obtain from (12), (13): 

2X = {g- f )D + vEDE-^ -uE-^DE; (16) 

D + {g + f)D + vEDE-^+uE-^DE = (17) 

Substituting X,D into (14), one gets: 

{g + f)DD + uDE-^DE + vEDE-^D = (18) 

Now, consider the two equations (9,10) with Q present. First, suppose that Q is time- independent, and exists. 
Then, Eq.(9) is satisfied with the choices (16-18) since multiplication of (9) by from the right reduces (9) to (8). 
In order to satisfy Eq.(lO) with the choice (15-18),the matrix Q must obey 

[Q,DE-^]^[Q,E-^D]=0. (19) 

Note that in general we assume that Q does not commute neither with D nor with E separately, [Q,E] 0; [Q,D] ^ 0. 
Proceeding along the lines [3] , we can get rid of time-dependence of D via a formal Fourier Transform 

Vp{t) = e'P^E^-^D(t)E-^ (20) 
fe 

Indeed, it follows from (20) that 

E-^Vp{t)E = e'PVpit); (21) 

Substituting (20), (21) into (17), one gets 

Vp + epVp = 0; Vpit) = e-'^'VpiO) 

with the "dispersion relation" 

ep=g + f + ve-'P + ue'P (22) 

The inverse Fourier Transform is 



D{t) = E^ dpVp{t) = E^ dpe-'-'Vp 



(0) (23) 



In what follows we shall omit the time argument in initial matrices ©^(0). Inserting (23) into (14), and using (21), 
one obtains: 

£/ / e"^'"^'''''*^Pi^f2«(Pi,f2)dpidp2 = (24) 

where 

a{puP2) = ue'P'+'P^ + (/ + g)e'P' + v (25) 
Now, integral in (24) may be split in two parts as 

TV /-TV /•H /-pi /•IT f-TT 

/ ... dpidp2 = / / ..•+/ /••• = -fp2<pi + Ip2>pi (26) 

-7r J —TV J —TT J —TV J-TvJpi 

By changing the order of integration and interchanging pi <-> p2 in the last term in (26) we obtain from (24): 



3 



-TT J — TT 

Since this is satisfied at all times t, we must require the expression inside the integrand to vanish 

T> V - ^ .27^ 

a{pi,P2) 

Finally, we require the matrix Q from (9,10) to satisfy [Q, E''~^ DE~''] = 0, which contains (19) as a special case 
and yields 

[Q,Vp(t)]=0 (28) 

To obtain Bethe Ansatz equations for the spectrum, consider the quantity 

Tr {Vp,Vp,...Vp^E'^Q), (29) 

which is the building block of the expression for expectation values. Indeed, for a system with just two particles the 
expectation value {nx{t)ny{t) ), according to (6), (21), (23), can be written as 

{nx{t)ny{t))= Tr {E-^DEy—^DE'^-yQ)/ZL = 
j dpi J dp2e-(^"+^''2)*e-'f^^-^f=J'Tr {Vp,Vp^E^Q)/ZL, 

where Zl is an appropriate normalization factor, Zl — J2x<y=i 2 l {nx{t)ny{t) ). Generally, one is interested in a 
system with N particles which leads to (29). 

Using (27), and commuting Vpi, around the circle, one obtains using (21), (28) and the cyclic invariance property 
of the trace: 

Tr {Vp,Vp, . ..Vp^E^Q) = (-1)^+^ [] "{^"'^'j e^^^^TV {Vp.Vp, . ..Vp^E^Q) 

n=i '^yPf'^Pn) 

and consequently 

(-i)-'ng^e'»'=i (30) 

One recognizes in (30), (22) the well-known expressions for the spectrum of the XX Z spin model, iov f = g = — 2 JA, 
u = V = 2 J. 

It may seem that the proposed line of argument is not changed if the auxiliary matrix Q that we have introduced 
is chosen to be a unity matrix Q = I. This trivial choice however would bring about an additional relation. Namely 
let us rewrite (29) as 

Tr {Vp.Vp, . . . 2?p_„£^) - Tr {Vp.Vp, . . . Vp^EE'^-^) (31) 
and then commute single matrix E around the circle. We shall obtain 

^ip-L+ip2 + ---ipN _ ^32) 

then. This means putting Q = I [ov more generally allowing for [Q, E] = 0) we recover only the part of spectrum 
with the total quasimomentum equal to zero, pi + P2 + ■ ■ - Pn = 0- 

We have thus shown how from the Dynamis Matrix Product Ansatz one obtains the spectrum for spin 1 /2 XX Z 
chain. Note that until now we have not got any restriction on parameters in (5). This is a consequence of the fact 
that the Hamiltonian (5) is integrable for any choice of parameters. In the following we show how the the integrability 
restrictions enter in a more general setting. 

Consider nearest neighbour quantum spin 1 Hamiltonians. This case corresponding to three states at a site, e.g. 
rij = 0, 1, 2 comprises many integrable systems (see e.g. a list given in [4] where however several symmetry restrictions 
are imposed). With those restrictions being relaxed, there are many more, e.g. [5,7]. 
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To be specific, we shall consider the hermitian Hamiltonian of the form 
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(33) 



with 8 independent parameters, li g = qb = gA = 1, d = e = and a = b = c = —1, it reduces to isotropic 
Hamiltonian of Sutherland [6] h = P — I, where P is permutation operator in SU (3) ® SU{3) defined by P(A ® B) = 
{B (g) A)P for any matrices A,B from SU{3). Again, the complete Hamiltonian has the form H = J2n=i 
we are interested in a solution of Schrodinger equation i-§i\P) = H\P). 

Analogously to (6) one proposes an Ansatz for \P{t)) as 



\P{t)) ~ Tr 




(34) 



with matrices D^, referring to local variable n; = 0,1,2 respectively. 

Ansatz (34) leads to the equations (8,9,10) where now (A| = {E D^), (X| = X^). Eq.(8) has 9 

components, written analogously to (11-14). The first one is satisfied with the choice (15). Those four that are linear 
in E, yield analogically to (16,17): 



+ 2aD^ + gA (E'^D^E + ED^E'^) 
2X^ = gA {ED^E-^ - E'^D'^E) ; 



(35) 



and the Eq. for , X^ is obtained by exchanging a ^ b, A ^ B. The additional Eqs.(9,10) lead to the conditions 
[Q,E''-^D^{t)E-''] =0, k = 0,±l,.. '.,Z = A,B on Q-matrix. 
Eliminating time derivatives in the four remaining equations that are quadratic in we obtain: 



(2a - d)D^D^ + gA [D^E-'^D^E + ED^E-^D^) = 
{a + b- c)D^D^ - gD^D"^ + gAED^E'^D^ + geD^E-^D^E = 
{a + b- c)D^D^ - gD^D^ + gAED^E-^D"^ + gAD^E-^D^E = 

(26 - e)D^D^ + ge {D^E'^D'^E + ED^E-^D^) = 



(36) 
(37) 
(38) 
(39) 



One proceeds analogically then to what we have done in the spin 1 /2 case. Introducing generalized Fourier Transform 
V^{t) = 2^^a'=e'P'=S'=-li:''-^(^)£;-^ V^{t) = Y.k P'"'^'^''' ^''^'^ {t)E-^ leads to eliminating the time-dependence in 



(35): V^ + epV^ = 0; V^{t) = e-'p'V^{0); Z = A,B, where 

e^ = 2a + gAiae'P + e'^f /a), e^=2b + gsiPe'^ + e-*7/3). 
The inverse Fourier Transform D^^^{t) = E^ j\dpV^^^{t), being inserted into (36-39), yields 

= j Api J dp2ai2V^^V^^e-^<+<>' 

0^ J dpi J dp2[d,2VlV^^ ^ gae'P-V^^V^^]e-<+<^* 
= 1 dpi J dp26i2X>p,I?p,e-«+<2)* 



(40) 

(41) 
(42) 
(43) 
(44) 
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with the functions 



ai2 = a{pi,p2) = ae'P'{2a - rf) + a^e'^'+'P') (45) 

612 = b{pt,p2) = {2b - e) + .95(1 + p^c'P^+'P-) (46) 

C12 = c{pi,p2) = ia + b- c)ac'P' + gBal3c'P'+'P- + gA (47) 

d,2 = d{pi,p2) - (a + 6 - c)Pe'P' + .g^a/3c^f 1+*"^ + ge (48) 

The trick with the p\ and P2 exchange in (41-44) leads consequently (see (27) and the paragraph above it) to 
■^pi P2 ai2 P^^^' ^pi'^P2 hi2 P'' 

ci2V^,'Dl - g(3e'P-V^^V^^ + c^i^P,^, - glie'P-V^V^^ = (50) 

di2VlV^^ - gae'P^V^X. + ^21^^^ " g^e'^'KK = « (51) 

and a restriction gs = cx/PgA', a = The latter one is a consequence of the constraint e^^ +€^2 ~ + ^P2' ii^eded 
to equate the time-dependent factors after pi <-> p2 exchange in (42,43). 
Eqs. (50,51) can be written in the form 

^A^B ^T^B^A d^29(}e'P- - d2ig(3eP- a^b g^a/3e^^^+'P^ - d^2C2i , 

PI P2 P2 PI ^^2^12 - ,g2a/3c2'Pi ^ P= PI ci2di2 - 52^/3e2»Pi ^ ^ 

„s„A^„A„B c^29ae^P' - C2igae^P- „ . ff^«/?e-^^+'^- - Ci2rf2i 

^Pi^P2 ^P2^Pi ci2rfi2 - 52a/3e2'Pi ^^P2^Pi ci2rfi2 - 52a/3e2^Pi ^ ^ 

The Eqs. (49,52,53) between the Fourier components 1)^,1)^ define an algebra conveniently written via a scattering 
matrix S as 

K'^pl = S^Y' {pi,P2)V^^Vl (54) 

Applying it twice we see that it satisfies the inversion relation {S'^ means transposition) S {pi , P2) S'^ {p2 , pi) = 1. 

Now, note that application of (54) exchange the order of indexes pi and p2- For the cubic terms V^V^^'Dp^ 
the exchange of order of indexes 123 321 can be done either by subsequent scries of 1 ^ 2, 1^3, 2 ^ 3 or 
2<-^3, l<-*-3, 1^2 exchanges. Associativity of the algebra requires the result to be the same in both cases, which 
amounts to 

Sl^,j„{pi,P2)Sl',2''(pi,P:i)S'j,k, {P2,P3) = Sf,f^„{p2,P3)Sf,l,{pi,pz)Sl,^^, {pi,P2). (55) 

This is the Yang-Baxter equation (YBE). Summing over repeating indexes is implied. The YBE guarantees the 
consistency of the algebra on the cubic and further levels. 

The YBE impose severe restrictions on the S matrix elements, which depend on the coefficients of the Hamiltonian 
(33). Nontrivial solutions of the YBE single out integrable models. We have investigated (55) with the help of 
Mathematica, and found the following solution: 

a = ii/3, gB = hgA, gA = «2ff, d = 2a+ {i3- l)g, 
e = 2b+ {i4- l)g, c = a + b + i^g, 

where ii, 12, 13, h, «5 = ±1- 

Sutherland's [6] and, more generally, solution 4 of [4] is contained in the above. To the best of our knowledge, 
the general manifold describes a new solution to the YBE. 

To summarise, the Dynamic Matrix Product State method turns out to be an effective tool to check the integrability 
of both stochastic processes and quantum Hamiltonians. Applying it saves the conventional tedious step of calcu- 
lating parameter-dependent transfer matrices satisfyng the the Yang-Baxter equation, commuting with the original 
Hamiltonian. E.g. for investigating spin 1 chains conventionally, we would need first to solve YBE with in principle 
272 independent components. In the DMPA approach we needed only the original Hamiltonian to start with, and 
then additionally to solve at most 82 equations (55) for the algebra associativity. (In fact the number of equations 
is much smaller due to symmetries). At the; same time, we believe that for all the integrable models obtained the 
commuting transfer-matrices do exist, although we do not need them directly. Also, Bethe Ansatz equations for the 
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spectrum can be constructed directly from the algebra, as was demonstrated for XXZ model (see (30)). For the 
other models the Bethe Ansatz equations are readily constructed [7] by following e.g. the algebraic approach [8]. 

The DMPA approach does not make reference to the actual representations of the matrices involved. However, it 
would be interesting to find them. In special cases (namely, when they are not time dependent, which means only 
stationary (ground) state is investigated) the representations are known [9,11,10]. 
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